Reinforcement Learning–Based Energy Management Strategy for a Hybrid Electric Tracked Vehicle
نویسندگان
چکیده
This paper presents a reinforcement learning (RL)–based energy management strategy for a hybrid electric tracked vehicle. A control-oriented model of the powertrain and vehicle dynamics is first established. According to the sample information of the experimental driving schedule, statistical characteristics at various velocities are determined by extracting the transition probability matrix of the power request. Two RL-based algorithms, namely Q-learning and Dyna algorithms, are applied to generate optimal control solutions. The two algorithms are simulated on the same driving schedule, and the simulation results are compared to clarify the merits and demerits of these algorithms. Although the Q-learning algorithm is faster (3 h) than the Dyna algorithm (7 h), its fuel consumption is 1.7% higher than that of the Dyna algorithm. Furthermore, the Dyna algorithm registers approximately the same fuel consumption as the dynamic programming–based global optimal solution. The computational cost of the Dyna algorithm is substantially lower than that of the stochastic dynamic programming.
منابع مشابه
A Novel Intelligent Energy Management Strategy Based on Combination of Multi Methods for a Hybrid Electric Vehicle
Based on the problems caused by today conventional vehicles, much attention has been put on the fuel cell vehicles researches. However, using a fuel cell system is not adequate alone in transportation applications, because the load power profile includes transient that is not compatible with the fuel cell dynamic. To resolve this problem, hybridization of the fuel cell and energy storage device...
متن کاملImplementation of real-time energy management strategy based on reinforcement learning for hybrid electric vehicles and simulation validation
To further improve the fuel economy of series hybrid electric tracked vehicles, a reinforcement learning (RL)-based real-time energy management strategy is developed in this paper. In order to utilize the statistical characteristics of online driving schedule effectively, a recursive algorithm for the transition probability matrix (TPM) of power-request is derived. The reinforcement learning (R...
متن کاملBattery and generator sizing of series hybrid electric vehicle based on experimental data and standard cycles simulation
Hybrid electric vehicles are getting more attention due to the fuel consumption and emission issue in megacities. Energy management strategy and battery capacity are the primary factors for the energy efficiency of range-extended hybrid electric vehicles. Iran khodro Powertrain Company has unveiled a series of hybrid electric vehicles and is improving its performance constantly. In the present ...
متن کاملReinforcement Learning Based Adaptive Energy Management on Diverse Applications for Embedded System
Use of adaptive energy management strategies is essential in improving energy utilization, efficiency, and sustainable operation of embedded systems. Accordingly, this paper presents embedded system applications, which are suitable for employing adaptive energy management utilized reinforcement learning. We proposed rewarding function for embedded system applications in stimulating the learning...
متن کاملEnergy Management Strategy for a Hybrid Electric Vehicle Based on Deep Reinforcement Learning
An energy management strategy (EMS) is important for hybrid electric vehicles (HEVs) since it plays a decisive role on the performance of the vehicle. However, the variation of future driving conditions deeply influences the effectiveness of the EMS. Most existing EMS methods simply follow predefined rules that are not adaptive to different driving conditions online. Therefore, it is useful tha...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2015